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(54) Data transmission in non-reliable networlcs 



(57) The present Invention relates to a method and 

apparatus for transmitting video and/or audio data in a 
non-reliable and bandiimlted network from a server to a 
ciient. The network may for Instance be a wireless net- 
work. The data stream Includes P-frames and l-frames. 
[f during transmission a frame gels lost, the client noti- 
fies the sen/er of the data loss when the next packet is 
received at the client correctly. The server then skips all 



the P-frames of the current P-frame sequence and con- 
tinues the tfansmtssion with the next l-frame. Preferably, 
each packet has assigned a sequence number and the 
message from the client Includes the sequence number 
of the currently received packet. The server may ignore 
a message from the dient if the clienfs request for skip- 
ping the P-frames has already been executed, it is pre- 
ferred to make use of the present Invention for streaming 
MPEG data. 
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Description 

[0001] The present invention relates to a data trans- 
misslor* method apparatus and more partftajlarly to vid- 
eo ancf/or audio slreamlng In a non-reflable and band- 
limiled network such as a wireless network. 
[0002] An example of a data stream of multimedia 
packets Is an MPEG (Motion Pictures Expert Group) 
stream. The MPEG stream consists of a flov/ of bit-pack- 
ets called frames or packets and Is streamed from the 
server to the client The stream usually contains Infor- 
mation in different formats and Is therefore a mixture of 
independent data, so-called Intra-coded frames or 1- 
frames, and dependent data, which depends on preced- 
ing data, so-called predictive-coded frames or P- 
frames. 

[0003] MPEG files which are stored on hard disks, 
CD-ROMs etc. are played back by MPEG playback de- 
vices which first retrieve the data from the storage de- 
vice, decompress and decode the data to audio and vid- 
eo digital signals, and then reproduce the signafs on the 
playback device such as a computer system. During 
playback of a selected MPEG audio/video playback file, 
many kinds of errors may occur, such as a fault In the 
memory or storage unit containing the playback file (e. 
g., a bad sector In a disk drive or CD-ROM drive), an 
error In a data path, or an error In data transm Iss Ion due 
to a fault In an output unit of the computer system. In the 
prior art, playback devices have therefore been devel- 
oped, which involve error recovery mechanisms. US 
5»784,527 discfoses such error handling in an MPEG 
playback system. If an error occurs, one of the disclosed 
recovery processes includes skipping unimportant 
frames until an I -frame Is reached. 
[0004] A completely different problem as compared 
with the error recovery in an MPEG playback system is 
the data transmission In non -reliable and bandllmiled 
networks. Typical examples of such networks are wire- 
less networks which are Inherently non-reliable since 
the wireless channels used for data transmission are er- 
ror-prone, have limited bandwidth^ and additionally the 
transmitted data is delayed or might even get lost due 
to network congestion. This is a severe problem in par- 
ticular in real-time streaming of MPEG files. 
[0005] FIG. 1 illustrates a conventional video stream- 
ing system. Video senrer 110 transmits video data 
through the non-reliable channel 150 to video client 160. 
For this purpose, the video server 110 Includes a trans- 
milter buffer unit 130 which receives data frames from 
video source application 120. in the transmitter buffer 
unit 130, the frames are then transmitted under control 
of channel access controller 140. In the video client 160 
the data are received fn a receiver buffer unit 1 70 which 
reassembles the frames from the segments. The video 
frames are then sent to video display application 180 
which might for example likewise be a storage device* 
or the like, 

[0006J The problems with the prior art systems when 



transmitting video or MPEG data via a non-relfable 
channel 150 will now be described tn more detail with 
reference to FiG. 2. In this example, the server transmits 
a sequence of i-frames and P-frames to the client. For 
5 explanatory reasons, each frame Is given a frame 
number (FN) indicating Its position in the MPEG stream. 
[0007] The server first transmits an l-frame, which is 
correctly delivered to the client after expiration of a cer- 
tain time delay. The second frame Is a P-frame, which 
^0 is dependent on the l-frame. The P-frame is also cor- 
rectly transmitted to the client. 
[0008] The third frame Is again a P-frame, which is 
therefore dependent on both the J-frame and the first P- 
frame. In the example of FIG. 2, P-frame FM=3 cannot 
1^ be received at the client, e.g. because of a network con- 
gestion. The following frames nevertheless pass chan- 
nel 150 with no error. Consequently, even though the 
sen/er has transmitted all the frames, the client did re- 
ceive frames FN=1 , 2, 4-9, but not Fh\^3. 
[0009] Since however P-frame FN=4 is dependent on 
P-frame FN-3, and the same is true for all the following 
P-frames up to the next l-frame, the client cannot use 
the P-frames although he has received them. This prior 
art system therefore Is highly Inefficient in Its usage of 
network resources since a number of frames has been 
sent but cannot be used. 

[0010] Anotherapproach of streaming multimedia da- 
ta through non-relfable channels involve the retransmis- 
sion of packets. While this approach Improves the QoS 
under bad channel conditions, it increases the required 
bandwidth in the network as well as the transmission 
delay. It is the refore not suitable for real-ti me multimedia 
streaming of data in networks having limited bandwidth 
and high error probability. Under such conditions, many 
reiransmission attempts are required and the real-time 
requirements can no longer be fuifilled. 
[001 1] It is therefore the object of the invention to pro- 
vide a method and apparatus for transmitting data in a 
non-reliable and bandllmited network, making efficient 
use of the limited bandwidth in case of data loss. 
[001 2] This object Is solved according to the invention 
as defined in the independent claims. 
[0013] According to the invention, the client notifies 
the sen/er in case of packet loss. Thus, the present in- 
vention provides a feedback from the client to the 
streaming sen/er, which allows the server to skip all the 
packets which depend on the iosf P- or l-frame. This is 
advantageous In that It saves bandwidth which can now 
be spent on other uses In the network or which can be 
used for increasing the throughput of that data stream 
rn which the packet loss has occurred. 
[0014] The present Invention further Is advantageous 
in that it adopts techniques In a network which were pre- 
viously known In the field of playback systems only, 
thereby providing a feedback interaction with the remote 
source. 

[0015] Preferred embodiments of the present inven- 
tion are defined fn the dependent claims. 
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[001 6] Assigning a sequence number to each packet 
leads advantageously to Improved frame control capa- 
bfllttes. Further, incorporating the sequence number of 
the current packet into the non-acknowledgement com- 
mand allows the server to lake Into account any signal 
delay in the network. This increases the reliability of the 
streaming system. 

[0017] Preferred embodiments of the present inven- 
tion will now be descilbed In more detail v^th reference 
to the accompanying drawings In which: 

FiG. 1 1s a prior art video streaming system; 
FIG. 2 IS a message sequence (^art Illustrating the 
operation of the video streaming system of FIG, 1 ; 
FIG, 3 is a video streaming system according to a 
preferred embodiment of the present invention; 
FIG, 4 is a message sequence char! for illustrating 
the operation of the video streaming system accord- 
ing to the present invention; 
FIG. 5 Is a (low chart Illustrating th e process of send* 
Ing a video stream according to a preferred embod- 
iment of the present invention; and 
FIG. 6 Is a flow chart illustrating the process of re- 
ceiving a video stream according to the preferred 
embodiment. 

[0018] Referring now to FIG. 3, the video streaming 
system according to the preferred embodiment of the 
present invention includes a video server 1 1 0 and a vid- 
eo client 160 which communicate via the non-reliab!e 
channel 150. The channel of the present embodiment 
is a wireless channel Contrary to the video streaming 
system of FIG. 1, the video client 160 comprises a loss 
defection unit 240 for detecting that a frame is missing. 
The video client 160 further includes a transmitter buffer 
unit being controlled by channel access controller 260, 
for transmitting from loss detection unit 240 a non-ac- 
knowledgement (HACK) packet to the video server 110 
in case of packet loss. For receiving the NACK packet 
from video client 1 60, video server 1 1 0 comprises a re- 
ceiver buffer unit 230 which has access to transmission 
controller 210. which Is connected to transmitter buffer 
unit 130. 

[0019] The operation of the video streaming system 
of FiG. 3 will now be described In more detail with ref- 
erence to FIG. 4. FIG. 4 shows a message sequence 
chart according to the present Invention. Inltfaiiy, an i- 
frame is sent from th e server to the client. In the example 
of FIG. 4, the I -frame has been given the sequence 
number SN=0, and the client Is capable of reading this 
Information. The l-frame Is received properly at the client 
and may therefore be used for displaying purposes. 
[0020] The second frame transmitted by the server is 
a P-frame, which is therefore dependent on the preced- 
ing I -frame. The P-frame has been given the sequence 
number SN=1 and is likewise correctly received at the 
client. 

[0021] The following P-frame has the sequence 



number SN=2 and is lost during transmission. That is, 
the client cannot receive this P-frame. 
[0022] In the example of FIG. 4 and in accordance 
with the example of FIG. 2, the fourth frame, which Is 

5 again a P-frame, Is then Iransmilted from the server and 
is correctly received at the client. The client, In evaluat- 
ing the sequence number, becomes aware that the pre- 
ceding P-frame having the sequence number $N*^2 is 
missing. The client then generates a NACK command 

10 including the sequence number of the currently received 
packet SN=3 and sends this NACK packet back to the 
server for notifying the server of the packet loss. 
[0023] As can be seen from FJG. 4, due to the trans- 
mission delay of the connection, the NACK packet is re- 

15 celved at the server later than the transmission time of 
the next P-frame having SN=4. This P-frame is therefore 
transmitted by the server in the usual manner. 
[0024] When the client receives the P-frame SN=4, it 
again evaluates the sequence number and generates 

20 and sends back a NACK packet including the sequence 
number SN^4. Sending this second NACK packet not 
only Is suitable for compensating for transmission de- 
lays but also takes Into account that In non-reliable net- 
works, even the first NACK packet may be destroyed 

26 due to e.g. network congestion. 

[0025] The server receiving the first NACK packet is 
notified that a frame has not been received at the client. 
Since the ciient cannot make use of subsequent P- 
frames, the server skips these frames and continues 

^0 transmission at the next l-frame. This frame which is 
then given the sequence number SN=5 corresponds to 
the I 'frame which had in FIG, 2 for explanatory reasons 
the frame number FN«8. 

[0026] Upon receiving the second NACK packet, the 

35 server determines by evaluating the sequence number 
that this command is already executed by skipping the 
P-frames FN-6 and 7, The server therefore ignores the 
second NACK packet and continues with transmitting 
the next P-frame FN-10 instead of again skipping alt P- 
40 frames up to the next l-frame. 

(0027] The process of sending a video stream will now 
be explained with reference to FIG. 6. 
[0028] In step S51 0, transmission controller 210 of 
video server 1 1 0 receives a frame from video source ap- 
-^5 plication 120, and assigns a sequence number to this 
frame in step S520. The sequence number may for in- 
stance be added to meta information Included in the 
frame header, but it may be appreciated by those of or- 
dinary skill In the art that any other kind of adding the 
50 sequence number to a packet may likewise be applica- 
ble. 

[0029] It is then determined in step S530 whether a 
NACK packet has been received from the video client. 
If this is not the case, the frame Is sent In step S570 to 
55 the transmitter buffer 130 and the process returns to 
step S51 0 for receiving the next frame from video source 
application 120. 

10030] If, however. In step S530 a NACK command 
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has been received at receiver buffer unit 230, the trans- 
m^slon controlter 210detefniines in step S540 whether 
the NACK command has already been executed. If the 
NACK command has already been executed, the cur- 
rent frame Is sent in step S570 to the transmitter buffer 
130 and the process returns to step S510. 
[0031] IncasetheNACK packet is the first one which 
has been received in the current P-frame sequence, the 
video server 1 1 0 determines In step S540 that the NACK 
command should not be ignored, and the processing 
continues with step S550. In this step, the transmission 
controller 21 0 waits for the reception of the next l-frame 
from video source appilcation 120» thereby skipping the 
remaining P-frames of the current P-frame sequence. 
The received i-1rame is then assigned a SM In step S560 
and transmitted in step S570 before the process returns 
to step S51 0 for continuing transmission of the following 
P-frames* 

[0032] Referring now to FIG. 6, the process of receiv- 
ing a video stream at video client 1 60 is described. After 
receiving a frame In step S610, the sequence number 
of the frame is revealed and evaluated in step S620. if 
upon evaluating the sequence number It Is determined 
that one of the preceding frames Is missing {step S630) 
operation of the loss detection unit 240 passes control 
to step S650, if It determined in step S650 that the cur- 
rently received data frame Is an l-frame, the process 
sends in step S660 the frame to video display applica- 
tion 1 80 and returns to step S61 0 since there is no need 
to inform the video server of the data frame loss. Other- 
wise, the loss detection unit 240 generates an NACK 
packet in step S670 Including the sequence number re- 
vealed In step S620. The generated NACK pacitet is 
then transmitted in step 6680 by transmitter buffer unit 
250 under control of channel access controller 260 
through the channel 150 bacl< to the video server 110. 
[0033] If It is determined in step S630 that no frame 
Is missing, the video client 160 adds the frame to the 
stream and forwards in step S640 the frame to video 
display application 180* The process of FIG. 6 then re- 
turns to step S610 for receiving the next video frame 
from video server 110. 

10034] While the preferred embodiment of the present 
tnve ntton h as be en described I n the context of streaming 
video data, it will be appreciated by those of ordinary 
skill in the art that another preferred embodiment may 
alternatively or additionally focus on streaming audio 
data. Preferably, the data stream is an MPEG data 
stream. 

[0035] Further the present invention has been de- 
scribed as preferrably operating In a wireless neUvork. 
Wireless networks Include any kind of networks in which 
data is transmitted through space by electromagnetic 
waves, including radio communication and cordless 
transmissions. The invention may however likewise be 
applied to data transmission over any other kind of non- 
reliable channels. 



10 



15 



20 



25 



30 



40 



45 



50 



55 



Claims 

1 . Method for transmitting video and/or audio data in 
a non-reliable network from a server {1 1 0) to a client 
(160), said data being arranged in data frames 
forming a data stream, said data frames Including 
P-frames and [-frames, the method comprising the 
steps of: 

receiving {S530) at the server a message 
(NACK) indicating that a data frame is missing, 
said message being sent from the client over 
the non-reliabie network; and 

continuing (S550-S570) the transmission of the 
data stream with the next [-frame, thereby skip- 
ping the P-frames up to said i-frame, 

wherein the client (160) can send plurat messages 
(NAGKs) relating to the same data frame loss until 
the next I-frame is received at the client and the 
server (110) ignores {S540) said message from the 
client If the server has already received a corre- 
sponding previous message from the client relating 
to the same data frame loss, 

2. The method according to claim 1, further compris- 
ing the steps of assigning a sequence number {SN} 
to each data frame. 

3. The method accord ing to claim 2, wherein said mes- 
sage from the client contains the sequence number 
of the last data frame which has been properly re- 
celved at the client. 

4. The method according to one of claims 1 to 3, 
wherein the data frames are MPEG frames. 

5. The method according to one of claims 1 to 4, 
wherein said non-reliable network is a wireless net- 
work. 

6. Apparatus for transmitting video and/or audio data 
in a non-reliable network to a remote client (160), 
said data being arranged in data frames forming a 
data stream, said data frames including P-frames 
and i-frames, the apparatus comprising: 

means (230) for receiving (S530) from the client 
a message (NACK) Indicating that a data frame 
Is missing, said message being sent from the 
client over the non-reilabie network; and 

a controller (210) for continuing (S550-S570) 
the transmission of the data stream with the 
next i-frame. thereby skipping the P-frames up 
to said l-frame, 
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wherein the client {1 60) can send plural messages 
(NACKs) relating to the same data frame foss until 
the next I -frame Is received at the client and the 
server (110) ignores (S540) said message from the 
client If the server has already received a corre- s 
sponding previous message from the ciienl same 
data frame foss. 

7. The apparatus according to claim 6, being arranged 
for performing Ihe method according to one of fo 
claims 1 to 5, 
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